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LYAPUNOV STABILITY CRITERIA 
FOR RANDOMLY SAMPLED SYSTEMS 


By Leonard Tobias 
Electronics Research Center 


SUMMARY 

This study is concerned with the asymptotic behavior of 
systems in which random sampling occurs; they are studied by a 
stochastic Lyapunov function method. The control loops under 
consideration consist of a random sampler (a sampling device 
which closes at a set of statistically described times in lieu 
of periodic intervals) , a zero order hold, a linear plant, and 
a feedback element. Sampled systems are modelled randomly when 
sampler imperfections, such as jitter or skipping, occur or when 
a single computer or communications link is a component of mul- 
tiple control loops (that is, when the availability times of the 
computer or communications link to a particular control loop are 
random) . This type of model has also been suggested for a human 
operator performing a compensatory tracking function. 

Improved stability criteria are given for systems whose 
inputs are identically zero for all time. When the feedback 
element is linear, sufficient conditions for asymptotic mean- 
square stability and asymptotic stability with probability one 
are obtained and compared. Necessary and sufficient conditions 
are also presented; these are used to analyze the value of the 
sufficient conditions. Intersample behavior is studied and 
results are presented for both stable and unstable plants. 
Numerical results illustrate the applicability and utility of 
the criteria presented and describe some interesting phenomena 
such as j itter- stabilized systems. When random inputs are 
present, a general method is given for the computation of the 
asymptotic mean-square output at sample instants. This method 
is illustrated by a computer program for a general second-order 
system. 

A randomly sampled Lure problem is studied and sufficient 
conditions for asymptotic mean-square stability and asymptotic 
stability with probability one are derived. 

INTRODUCTION 

This study is concerned with the asymptotic behavior of 
systems in which random sampling occurs. A random sampler is 
a sampling device which closes at a set of times t^ , t-2 , • • , 
which are known only in a statistical sense. 
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Random sampling may occur unintentionally due to physical 
imperfections in the sampling device. That is, a system is 
desired in which periodic sampling occurs, but device imperfections 
prevent this from happening. These imperfections are usually of 
two types — imperfections in timing (jitter) and imperfections 
in closing (skipping) . In the case of jitter, the sampler does 
not close precisely at the periodic sample times, but in some 
neighborhood of these times . Skipping occurs when the sampler 
is supposed to close at times, nT, but fails to make connection 
at some of these times. If probability information is available 
regarding the jitter width or the probability of skipping, then 
precise stability conditions can be formulated. (Clearly these 
will be different from the conditions for stability of periodically 
sampled systems) . 

Intentionally randomly sampled systems may occur for many 
reasons. Recent years have seen the increased use of digital 
computers as components in control systems . This has introduced 
new problems, since the digital computer accepts and supplies data 
at discrete time instants; also, the same computer is often a 
component of many control loops . Because one system may require 
the full use of the computer during critical stages, the avail- 
ability times of the computer to a particular process may be 
described only in some statistical sense. 

Space systems seems to be an area of fruitful applications 
of random sampling analysis techniques. Consider an unmanned 
Earth-controlled vehicle. Suppose it is desired to maintain a 
constant velocity as the vehicle moves about the irregular, 
hilly surface of the Moon. The vehicle carries a velocity sensor; 
velocity information is sent via a communications link to an 
Earth-based human operator, who sends velocity commands back to 
the vehicle. However, via the same link, information regarding 
surface rocks and soil, photographs of the lunar surface, etc., 
must be transmitted. Due to the multiple systems it must handle 
and due to the unknown time of processing of information from 
each task, the availability times of the link to a particular 
task are random. Stability analysis is necessary to determine 
the feasibility of performing a particular task. 

There is a considerable active engineering interest in 
obtaining mathematical models of the human operator in compensa- 
tory tracking functions. Some consideration has been given by 
G. Bekey et al . (ref. 1) to modelling the human operator with 
randomly sampled systems. Young et al. (ref. 2), have proposed 
a system for modelling of eye-tracking. Their model includes 
two kinds of control. The first, called pursuit control, is an 
open-loop control which is a continuous function of the rate of 
target movement. Saccadic (or jump) control is the second type 
of control which is introduced to account for large discrepan- 
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cies in eye and target position. It is closed loop and is 
modelled as a sampler and hold followed by non-linearities and 
delays. Two types of sampler models have been proposed — target- 
synchronized and non-synchronized. The former implies that there 
is a stochastic delay between the time the target moves and the 
sampling time. The latter implies that samples are taken whether 
or not retinal error has occurred. 

Hence, an analysis of randomly sampled systems is required. 

Some effort has been made in this direction, but much more 
remains to be investigated. Brown (ref. 3) has investigated 
sampled systems with jitter; filtering and control aspects of 
randomly sampled systems are discussed in Chang (ref. 4). 

The class of systems depicted in Figure 1 is considered. 

The zero-order hold is a device which accepts the sample e(t^) 
as input at time t^ , and has an output e(ti) for t in the in- 
terval [ti, t-L+i) . Plants under consideration will be linear. 

The first-order plant will be studied, followed by multiple- 
order plants (computer implementation for multiple-order stabil- 
ity conditions will be carried out). Feedback will, for the most 
part, be linear, but scalar non-linear elements are also considered. 
Asymptotic stability results will be presented for systems in 
which the input is identically zero; also, mean-square output 
behavior will be examined when the input is a stationary random 
process . 


u(t ) 



Figure 1.- The general randomly sampled linear system 


3 




The method of approach is a stochastic Lyapunov one; that 
is, as in the deterministic sampled problem, one seeks a non- 
negative functional V n = V (x n ) of the solution paths {x n } such 
that V n +i - V n is non-positive. The Lyapunov functions used 
(1x1 s for the scalar linear case, x'Wx for the multivariable 
linear case and x ' Hx + g -£ a f(a)da for the Lure problem) have also 
been used for deterministic problems; however, the introduction 
of randomness changes the framework of stability statements to 
a probabilistic one; also, system performance may be radically 
altered by introduction of randomness. 

In the following section, areas of application of this 
stability analysis are presented. Then results for undriven 
systems are presented followed by the driven results; the 
techniques are then used in non-linear systems. Some of the 
results for undriven systems can be found in reference 5; for 
proofs of the conditions stated in this report, see author's 
doctoral thesis (ref. 6). 

The contributions of Professor Leonard Shaw of the Polytechnic 
Institute of Brooklyn and Professor Harold Kushner of Brown 
University in the development of the theory of stochastic control, 
in particular, as pertaining to the work presented in this 
document, are gratefully acknowledged by the author; the author 
is indebted to them for many helpful discussions and suggestions 
during the course of this work. 

STABILITY OF LINEAR UNDRIVEN SYSTEMS 

This section is concerned with the class of systems which 
can be modelled as in Figure 1. The simplest of cases is con- 
sidered first; the case when the plant is first-order linear 
and the feedback is a scalar constant K 2 . The plant is repre- 
sented by K]_/s+r]_. This has been redrawn as Figure 2. Precise 
definitions of the types of stability considered appear in the 
appendix, as well as some fundamental theorems. The following 
notational conventions are adopted. 

Nl: Let 0 < t]_ < t 2 < . • • be the set of times at which 

the sampler closes 

N2: 4 t i+1 - tj_ 

N3 : f^ (x) = probability density function of Aj_ 

i 

N4: (J>i (s) ^ characteristic function of f^ 

= E [e _sA i ] = f f A . (x) e _SX dx 

* / o 

N5 : K = K 1 K 2 
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N6: X n = X(t n ) 


Assume that (Al) Aj_ are independent and identically distributed 
and (A2 ) t D = 0 wpl and x(0) / 0 wpl . 


u ( t )=0 



Figure 2.- Basic system for linear first-order undriven case 


T heorem 1 - If r > 0, a necessary and sufficient condition 
for the system in Figure 2 to be asymptotically stable of order s 
is 


E | (1+K/r) e rA - K/r | S <1. (1) 

If r < 0, we require the additional assumption that (A3 ) ^i < T m' 
where T m < 00 is a constant independent of i. Note that for the 
case s = 2 we have asymptotic mean-square stability and the con- 
dition (1) can be written 

(1+K/r) 2 <p (2r) - 2K/r (1+K/r) cf> (r) + (K/r) 2 < 1. (2) 

The inequality (2) can be found in Kalman (ref. 7) and Leneman 
(ref. 8) . However, the cases when s / 2 and r < 0 are not treated 
there. The condition for stability of order, s, can, via the Doob 
Martingale Convergence Theorem, be used to establish a sufficient 
condition for asymptotic stability wpl. 

Theorem 2- A sufficient condition for the system in Figure 2 
to be asymptotically stable wpl is that for some s > 0, the 
system is asymptotically stable of order s. 

Note that the condition for mean-square stability is not 
necessary; that is, it is possible for the system to be stable of 
order s < 2 but not for s = 2. 
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To illustrate how one can use these conditions, consider 
Eq. (2). After some manipulation it becomes: 

K k\ _ <j> (r)-<J> (2r) I 2 f 1 z± (r) 

r/ l-2tj) (r) + <|>(2r)J [l -2 ^ (r) + * (2r) 

From the above, we deduce that for asymptotic mean-square stability 
K must lie in the range: 


-1 < K < 


r (l-<j> (2r) ) 

1— 2 <f> (r) + <p (2r) 


(3) 


We now consider how the range of K is affected by parameter 
variation of the densities. 


Example 1, Exponential .- For exponential sampling with para- 
meter X , 


f A (x) .. 


Xe' Ax x i 0 

0 x < 0 

It is readily shown that <p (s) 
From Eq. (10) , 

r (1-<|> (2r) ) 


K 


max l-2<}) (r) + <p (2r) 


r (1 - 


X 


X+2r 


) 


(1 - 


2X 


X 


X+r X+2r 
and via some simple algebra 


K = X + r 
max 


) 


X 

X +s 


Thus, 3K max/3X = 1; we can show that E (x) = 1/X . Thus, we have 
demonstrated the reasonable result that if the mean sampling time 
decreases, the maximum allowable gain for stability increases 
(for the first-order system under discussion) . 


Example 2, Uniformly distributed jitter over a time range of 5 
centered about a nominal sampling interval T.- From the appendix 


<M s) = e 


_ -sT sinh (sfi/2) 


s6/2 


and using Eq. (3) 
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1 


K 


max 


,, -2rT smh r 6. 

r(l - e ~ ) 

rfi 

-rT sinh r 6/2 -2rT sinh r 6 
(r6/2 ) + e r6 


Note that when 6=0 


K 


max 


r (1+e rT ) 
(l-e- rT ) 


which is the standard result obtained by conventional periodic 
sampling analysis. A straightforward but tedious calculation 
shows that 


8K 2 

max r ... . , 

~~d6 = “2 <l_4 Sinh 

m 


|[- 4 sinh iri 


- 2r6 cosh 


Ml 


-rT 


+ [2 sinh (r6)-2r6 cosh (r6)]e 


-2rT 


[ 


4 sinh 


cosh(rfi) + 2 cosh 
-4rT) 


sinh (r6 ) e 


] 


-3rT 


- [2 sinh(r6) cosh(r6)]e 


where m = r6 - 4e rT sinh^-^j + e ^ rT sinh(r6) 

The above indicates analytically the manner in which the maximum 
gain varies from a given T as a function of the jitter. 


Before leaving the scalar case, let us briefly examine the case 
of non-linear feedback. Suppose that in lieu of the previously 
considered constant feedback gain K 2 , we consider a non-linear 
feedback element where f satisfies 

f(x ) 

0 £ y = 2— < y < 00 (4) 

n x “ 


It is readily shown that if the system is asymptotically stable 
of order s when the feedback is the constant ^ 2 ^' then it is 
stable for all scalar non-linearities satisfying Eg. (4). 
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MULTIPLE ORDER SYSTEMS 


We 

dx 

dt 

where x 
matrix . 


Sufficient Conditions 
now consider the system of Figure 3. 

= Ax - ine n , 

and e n are N vectors, m is a scalar. 


For te <t n ,t n+1 > , 

(5) 

and A is an N x N 


u(t )*0 



Figure 3.- Basic system for linear multiple-order case 


Let K' be the feedback N vector and define C = mK' 
we may rewrite Eq. (5) as 


Thus 


& = Ax - C * 
dt n 


(6) 


Hence x (t) = e A ^ Si^x n + 




A (t-T ) , 
e dx 


n 


C x 


n 


and at sample instants, x n+ j = (e A ^n(I-A ‘*"C) + A ^C)x n 


or 


x , , = A x 
n+1 n n 


(7) 
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where 


( 8 ) 


A n = e AA n(I-A 1 C) + A 1 C 


We restrict attention in the multiple-order case to mean- 
square stability and stability 'with probability one. Recall that 
in the first-order case, a necessary and sufficient condition for 
mean-square stability is that E (a£) < 1, where a n = (1+K/r ) e -rA n 
- K/r. One might suspect that the extension to multidimensions 
is that the eigenvalues of the matrix E (AnA n ) be in the unit 
circle. The above is a sufficient condition; that it is not 
necessary will be clear from the ensuing theorems. 

Theorem 3- Assume A1 and A2 . In addition, assume A3 if any 
of the eigenvalues of the matrix E (A^A n ) lie on or outside the 
unit circle. A sufficient condition for the randomly sampled 
systems of Figure 3 to be asymptotically mean-square stable is 
that all the eigenvalues of the matrix E (A-^An) lie in the unit 
circle . 

AA. -1 -1 

Now let H = E [e 1 ] (I-A X C) + A ± C (9) 

AA. AA. , 

G ± = (e 1 -E (e 1 ) ) (I-A C) (10) 

Using this notation, we can write Eq . (7) as 


X 


n+1 


(H+G )X 
n n 


where E [G n ] = 0. Hence we have represented the system as a 
deterministic system H with random perturbation G n . Suppose 
that the deterministic system 

^n+l “ Hy n 


is asymptotically stable. Let W be the solution of H'WH - W = -Q 
for some positive definite Q. Then it can be shown that the per- 
turbed system is asymptotically stable wpl if EtG^WGn] - Q < 0. 

A computer study was undertaken to illustrate the application of 
this criterion. This study will be described presently but first 
necessary and sufficient conditions for asymptotic mean-square 
stability will be presented; these can be used to gauge the merit 
of the sufficient conditions. 

One might naturally ask at this point, why bother with 
sufficient conditions at all if necessary and sufficient con- 
ditions are available? The answer is that the sufficient con- 
ditions are easier to apply; also Lyapunov functions may be 
known for the unperturbed system which may still be valid for 
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randomly perturbed systems. Finally, the methods of proof for 
the sufficient conditions can be extended to non-linear situations. 

Let us then briefly consider necessary and sufficient con- 
ditions in light of the above and then turn our attention to the 
computer study. Necessary and sufficient conditions for asymp- 
totic mean square stability of discrete systems were first 
obtained by Bharucha (ref. 9) in terms of Kraonecker products. 

Consider the equation E(A'WA) - W = -Q where W and Q are 
positive definite and symmetric. Let the n(n+l)/2 dimensional 
vector W and Q denote vectors composed of all the elements of 
W and Q, respectively. (Note that the vectors W and Q are not n^ 
vectors because W and Q are symmetric.) Then, E(A'WA) - W = -Q 
may be written as 

AW - W = Q 


Then a necessary and sufficient condition for asymptotic mean- 
square stability is that the roots of A lie in the unit circle. 

Computer Results 

The purpose of the computer study is to illustrate the use 
of the derived necessary and sufficient conditions and to deter- 
mine the usefulness of sufficient ones. For the computer study, 
attention was focused on the system shown in Figure 4. The sys- 
tem is second order with two negative real roots r^ and r 2 , and 
the feedback is a constant gain K. The system equation is 

TT " (r l +r 2 ) !! + r l r 2 x - - K x n for “‘VSl+l 1 (12) 

at 

Let 


y = 

dx 

dt 

(13) 

3 = 

K / r l r 2 

(14) 

a = 

1+3 

(15) 


1 

(16) 

P = 

r 2 _r l 
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u( t ) = 0 



Figure 4.- The second-order plant with two negative real roots 


At sample instants, it can be shown that the above system is 
given by 



where 


r 2 r l A r 2 A r l A r 2 A 

'ap e - apr 1 e - 3 - pe + pe ^ 


A = 
n 


l a P r 1 r 2 e 


r l A 


ap r i r 2 e 


r 2 A 


(1 


r l A r 2 A 

- pr x e + r x pe 


If the following random coefficients are needed for the computa- 
tion of E(a'wa) and A: 


ECa^) = 


- 2 r^r 2 <J) (r 1 +r 2 ) + r^<|> (2r 2 ) } 


-2a$p{ r„(f) (r, ) - r,4>(r 9 )} + 


(ap) 2 {r 2 cj) (2r 1 ) 




E(a ll a 12 } = -ap 2 { r 2 4> ( 2r i) - (r 1 +r 2 )4> (r 1 +r 2 ) + ^<*>(2^)} 

-$p{-4> (r 1 )+<j) (r 2 ) } 

E ( a ll a 2 l) = ^ ^ r l r 2 ^ r 2 ^ 1 ^ — 2 ^ ^ ^ 2 ^ r l^ ^ r 2 ) ^ 

-Bapr 1 r 2 ( 4 ) (r x ) - 4 > (r 2 ) } 

E ( a ll a 22 ) = a P 2{_r i r 2 <f) (2r l ) + (r l +r 2) * ( r 1 +r 2 ) “ r i r 2 <},(2r 2 )} 

-Bp{-r 1 4> (r x ) + r 2 <J>(r 2 )} 

E(a 2 2 ) = p 2 {<f>(2r 1 ) - ?^U 1 +r 2 ) + <)>(2r 2 )} 

E(a 12 a 21 ) = -ap 2 r 1 r 2 {()) ( 2 r x ) - 2<J>(r 1 +r 2 ) + 4> ( 2 r 2 ) } 

E(a 12 a 22 ) = p 2 {r 1 <j) (2r 1 ) - (r^+r 2 ) <p (r 1 +r 2 ) + r 2 <p (2r 2 ) } 

E(a 21 ) = (apr 1 r 2 ) 2 {<p (2r 1 ) - 2<})(r 1 +r 2 ) + <f> (2r 2 ) > 

E(a 21 a 22 ) = ap 2 r 1 r 2 {-r 1 cj) (2r 1 ) + (r 1 +r 2 ) <J> (r ] _+r 2 ) - r 2 <p (2r 2 ) } 

E(a 2 2 ) = p 2 {r 2 <f> (2r 1 ) - 2r 1 r 2 c}) (r 1 +r 2 ) + r 2 <}>(2r 2 )} 

Hence E(A'WA) -W = Q may be written as 

E(a 2 1 )w 11 + 2E ( a n a 2i^ w i2 E ^ a ll a 12^ w ll + E ^ a ll a 22 

+ E ^ a 21^ W 22 + a 21 a 12^ W 12 + E ^ a 21 a 22 ^ w 

E(a ll a 12 )w ll + E(a ll a 22 E(a 12 )w ll + 2E (a 12 a 22 )w 12 

\ + a 2 i a i 2^ W 12 + E ^ a 21 a 22^ W 22 + E ^ a 22^ W 22 

_ All W 12\ _/ q H q 12 \ 

\ W 12 W 22 / \ q 12 q 22/ 
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In column vector form. 



/E(a^) 2E(a 1]L a 21 ) 


1122 ' 


2E ( a 12 a 22^ 




The sampling considered was uniformly distributed jitter 
with a range 6 centered about a nominal sampling interval T. It 
should be clear from the above that the parameters in this study 
are r^, r 2 , T, 6, K; for a given set of such parameters, one can 
compute E(a'wA) - w (for a given W) and also A by using the for- 
mulas given above. 

In one series of runs r-j_, r 2 , T and K were fixed; 6 was 
varied and for each 6, the matrix A was computed. Let p = maximum 
magnitude of any eigenvalue of A. Hence, plots of p vs 6 could 
be obtained. A sample plot is shown in Figure 5. The line p = 1 
represents a stability boundary. By the theorem derived earlier 
p < 1 is a necessary and sufficient condition for mean-square 
stability. The line 6 = 2T is a physical boundary since if 
6 > 2T, it means that there is a positive probability that the 
(n+l)st sample occurs prior to the nth sample. For the typical 
plot shown p]_ = p (o) = the maximum eigenvalue without jitter. 

6 max = the amount of jitter above which the system is unstable. 
Figure 6 represents an actual run for the set of parameters shown, 
where p^ = .7 and 6 max = .61. The interpretation of the graph 
is that the introduction of jitter causes an increase in p; when 
a sufficient amount of jitter is introduced, the system is no 
longer mean square stable; hence, one may conclude that jitter is 
destabilizing for this set of parameters. Figure 7 is another 
plot of p vs. 6. Here p]_ = 1.06, but as 6 increases, p decreases. 
In fact, in the region 6 e [1.85, 3.152] the system is operating 
in the stable region. Hence, the conclusion is that jitter has 
stabilized a deterministically unstable system. 

In order to check this surprising result, a digital simula- 
tion was made. A standard IBM 9094 random number routine, RANDU, 
generated a series of pseudo-random numbers uniformly distributed 
between zero and one. These numbers were then shifted and 
stretched so that a sequence of numbers with a uniform distribution 
6 about a nominal sampling time T was obtained. Then the recur- 
sive equations (17) were solved iteratively. This was done for 
the initial conditions x G = 1 and y D = 0 and the same parameters 
as in Figure 7. The values x n , y n , A n were printed out for n = 1, 
..., 1000. With 6 = 0 (no jitter), x-^qqo = 1.81 x 10-*- 2 and 
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YlOoo = -8.32 x 10 11 . (Standard deterministic analysis shows 
that for K > 5.86, the system is unstable.) With 6 = 1.0, 
x 10oo = “*183, yiooO = -*0562. Clearly the system is on the 
verge of instability. With 6 further increased to 2.5, x n = y n 
= 0.0 x 10 - 38 for n > 400, indicating that the system is now 
stable . 

Runs were also made for fixed rj, r 2 , T in which 6 max 
was plotted against K. Some results are in Figures 8 and 9. 

A series of runs were made to determine the effect of the 
choice of Lyapunov function on the stability estimate. Recall 
that it has been shown that for a given W which is positive 
definite and symmetric, if 

e(a'wa) - W < 0, 

then the system is mean-square stable and asymptotically stable 
with probability one. Since the condition p < 1 is necessary and 
sufficient, the goodness of the estimate using a particular W can 
be determined by finding the min 6 = 5^ such that E(a'wa) -W < 0 
is no longer valid and comparing it with 6 max. 

The following series of runs were made: fix r-^ , r 2 , K and T 

(K and T were picked so that with 6=0 the system is stable) . 

For Q =(^ 03 )' w which satisfies A^WA T - W = -Q where A T is 

the matrix A when 6=0. Jitter is introduced incrementally and 
E(a'wa) - W is computed until 6 W is determined. The run of Table I 
is for T = 1., K = 10., r = -1., r 2 = -2. 



From Figure 8, S max = .42. Hence, satisfactory bounds are obtained 
as q 3 + 0. Table II illustrates a series of runs for Q = Qji j) 
and the same parameters r 2 , K, T as Table I. Clearly, satis- 

factory bounds are obtained as q^ gets large. Hence, it seems 
that limiting values of q^ and q 2 yield Lyapunov functions with 
the best estimate. Table III is included here to show that off- 
diagonal elements do not seem to improve the estimate Note that 
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LINEAR DRIVEN SYSTEMS 


Suppose that the system previously considered is driven by 
a non-zero input u(t). The class of inputs u(t) which will be 
considered are those which can be represented as outputs of a 
linear filter driven by white noise. The system under consider- 
ation is depicted in Figure 10 and is given in equation form 
below: 


3 

II 

Xl-P 

+ Bu - Cx 

n 

(19) 

du = Du 

dt + Fdw 

(20) 


dw 

where is white noise. (For a discussion of equations like 
Eq. (20), see reference 10.) 



Figure 10.- System with gaussian input 


At sample instants, Eqs. (19) and (20) become 


AA , AA 

r n _ ± » _ 

x n+l = [e +A (I_e 


fSvt-l A (t , , — t ) D (t— t ) 
n )C]x n + [J e Be dx]u n 


n 


/ fc n+l A (t , — t ) f T D(t 

e B[J e 


"f) 


Fdw(t)] dx 


n 


n 
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Thus we can rewrite the above as 


y n+l = A n y n + V 


It can be shown that if y n +i = Ay is asymptotically mean-square 
stable, then 


lim E[y^Qy n J = E[b'Wb] 


where Q > 0 and W > 0 satisfies 


E(A'WA) - W = - Q. 


Thus, we can compute the asymptotic mean-square behavior if 
we know certain undriven properties of the system (the Lyapunov 
function W) and the parameters of the input. It is also possible 
to obtain estimates of intersample behavior but this will not be 
done here. The procedure is straightforward and will now be 
illustrated by a second-order example. 


18 



We consider the system shown below (Figure 11) : 



Figure 11.- A second-order driven system 


The expression u(t) is a stationary process with autocorrelation 
“ r 3 t 

R u (t) = e r 3 < 0 ( 21 ) 

2 

We seek lim E (x ) . 

n n 

Solution . - First, in order to apply the previous theorems and 
corollaries we need an appropriate model of the input process, 
u(t). The model we seek is a differential system driven by 
white noise; it can be shown (Papoulis, ref. 11) that a suitable 
model is 


du = r^ u dt + /- 2 r 3 dw 

Thus, the input system at sample instants may be represented by 

'n+l 


r 3 A 

u n+l ' e u n + *^3 


/ t 


r 3 (t n+l" T) 
e J n x dw (t ) 


( 22 ) 


n 


By slightly modifying the analysis in the previous computer 
study (p. 10 ) of a second-order example to include an input, we 
can obtain the following system of equations at sample instants: 


n+l\ 


'n+l 


n+l/ 
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A is defined by Eq. (18) . 
n 



h n is a normal random variable with 0 mean and variance l-<f>(2r.,). 
In addition, the following constants will be needed. 3 

E(c 2 ) = <j>(2r 3 ) 

E(b 2 ) = (Bp) 2 [r 2 <J> (2r 1 ) - 2r 1 r 2 <|> (r.j+r 2 ) + r 2 cj>(2r 2 )] 

- B 2 p (r 2 <|) (r x ) - r 1 4>(r 2 )) + B 2 

E(b 2 ) = (Bp) 2 (r x r 2 ) 2 j^(j> (2r x ) - 2<}>(r 1 +r 2 ) + 0 ( 2r 2 ) J 
E(bi b 2 ) = (Bp) 2 r 1 r 2 |^r 2 <M2r 1 ) - (r x +r 2 ) <J> (r 1 +r 2 ) H-r-^Ur^J 

- B 2 pr^r 2 {tj> (r^) - <f)(r 2 )} 

E ( a 11 c ) = ap{r 2 <{) (r 1 +r 3 ) - r^lr^rj)} - 8<f>(r 3 ) 

E( a 12 c ) = -P^)(r 1 +r 3 ) + p<p(r 2 +r 3 ) 


20 



E ( a 2i c ) = apr 1 r 2 {(j) (r 1 +r 3 ) - (f>(r 2 +r 3 )} 

E ( a 22 c ) = -p{r 1 <}) (r 1 +r 3 ) - r 2 <f)r 2 +r 3 ) } 

E^c) = -Bpr 2 <(> (r 1 +r 3 ) + gpr.^ (r 2 +r 3 ) + g<j>(r 3 ) 

E(b 2 c) = - gpr-^r 2 { 4> (r 1 +r 3 ) - <f>(r 2 +r 3 )} 

E( a llbi) = -ap 2 B{r 2 4> (2r 1 ) - 2r 1 r 2 <f> (r 1 +r 2 ) + r 2 cj)(2r 2 )} + 3 2 p{r 2 <f> (r 1 ) 

- r 1 4>(r 2 )} + a6p{r 2 <j) (r 1 ) - r 1 <J)(r 2 )> - g 2 

E( a i 2 b i) = 3p 2 {r 2 4> (2r 1 ) - (r 1 +r 2 ) <f> (r 1 +r 2 ) + r 1 <Ji(2r 2 )} - p 3 -C (r x ) 

- $ (r 2 ) } 

E ( a 2 i b i ) = 3r 1 r 2 p z {r 2 <j) (2r 1 ) - (r 1 +r 2 ) cj> (r 1 +r 2 ) + r 1 4>(2r 2 )} 

+ a3pr 1 r 2 {4> (r^) - 4>(r 2 )} 

E( a 22 b 1 ) = 6p 2 {r 1 r 2 4> (2r 1 ) - (r 2 +r 2 ) (f) (r 1 +r 2 ) + r 1 r 2 4> (2r 2 ) } 


- pe{r 1 cj)(r 1 ) - r 2 cf)(r 2 )} 

E( a nb 2 ) = -aBp 2 r 1 r 2 {r 2 4> (2r 1 ) - (r 1 +r 2 ) 4> (r 1 +r 2 ) + r 1 4)(2r 2 )} 
+ 3 2 pr 1 r 2 {<J) (r 1 ) - cj>(r 2 )} 

E( a 12 b 2 ) = gp 2 r 1 r 2 {(j) (2r 1 ) - 2<j>(r 1 +r 2 ) + 4>(2r 2 ) } 

E(a 21 b 2 ) = -ag (r 1 r 2 p) 2 {<}) (2r 1 ) - 24 >(r 1 +r 2 ) + 4>(2r 2 ) } 

E( a 22 b 2 ) = gp 2 r 1 r 2 {r 1 t() (2r 1 ) - (r 1 +r 2 ) <j> (r 1 +r 2 ) + r 2 <j)(2r 2 )} 
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We must now solve E(A'WA) -W = -Q for W, where 



E (A ' WA) 


E (A'WA) 
E (b'wA) 


+ e(cw'a) 


E(A' wb) + E(A'WC ) 

E(b'wb) + 2E(Cb')W + E(C 2 )W 6 


Thus, the solution of E(A'wA) - W = -Q may be carried out via the 
consecutive solution of 


E (A'WA) 

E(b'WA) 

E(b'Wb) 


+ 


+ 


W = - ( ) for W 

\0 0 / 

E(CW'A) - W = (0 0) 


2E (Cb ' ) W + E(C 2 )W 6 - 


for W 

W, = 0 
6 


for W, . 
6 


This is a simple matter for the digital computer. From theorems 
previously developed 



or lim E ( x n x n ) = E ( h n^ W 6 = T 1- ^ ^ 2r 3 M W 6 * 

T1 *- J 
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I 


As an illustration, consider the sampling device to be subjected 
to uniform jitter, D, about nominal sampling time, T. Let 


K = 10.0 
T = 1.0 


D = .2 



r 3 = -- 5 


With the above data and using a straightforward Fortran program, 
we find that 

limE (x 2 ) = 1.519 x 10 2 = 151.9. 
n n 

At first glance, t his migh t seem unusually large since the 
variance of u is / ( 2 ) (.5) = 1. However, note that the gain K 
is in the forward loop and so with K = 10 the input variance 
is 100. With K in the feedback loop, the asymptotic value of the 
output's second moment was computed to be 1.519. 

RANDOMLY SAMPLED LURE PROBLEM 

The methods developed for linear systems will now be utilized 
to analyze a system with a scalar non-linear feedback element. For 
a discussion of the deterministic problem, see Lefshetz (ref. 12) . 


The system equations are (see Figure 12): 

x = Ax - mf(o n ) te[t n' t n+l ) (23) 


a 


C 1 X 


(24) 


where x, m, and c are N vectors and a is a scalar; where A is 
an asymptotically stable N x N matrix; a n = a(t n ), and the 
following assumptions are placed on the scalar function f: 

f(0) = 0 

erf (a) > 0 a ^ 0 


23 


I 



I (a) = f f (d)dd >_ 0 


I (a) 


as a + ±» 



Figure 12.- The randomly-sampled Lure problem 
A straightforward integration of Eqs. (23) and (24) yields 


x . . = A x + a f (a ) 
n+1 n n n n 


cr , . = a - bx + r 
n+1 n n n n 


where 


AA 


A = e 
n 


n 


n 


AA 


I 

n 


'Li - 

rx LA 

e ): 

i — 1 

AA 

A X (I 

- e 

i -i r 


A A 

I + a' 


ru 


AA 


(X - e S] 

u l Ai J 

We consider the Lyapunov function 


m 


V(x,a) = x'Hx + q J° f (a) 


da 
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where q > 0 and H is positive definite. This has been used by 
Szego and Pearson (ref. 13) for the discrete time deterministic 
Lure problem. The following applies to the system of Figure 11. 
Suppose that there is an H > 0 and a q > 0 such that < 0 and 

p > dC 1 1 d' 


where 


C 1 =[ E A >n - H + ^ b „ b n] 

d ' - E [ a >n " 5^ r n b n “ 

p = Efa'Ha + qr + H^r^l 

K L n n ^ n 2nJ 

Then the system is asymptotically stable wpl . 

One can obtain bounds for intersample behavior and can 
obtain estimates of asymptotic behavior when inputs are present, 
but these questions will not be considered here. 

CONCLUSION 

Systems which can be modelled as randomly sampled linear 
systems have been studied by a stochastic Lyapunov function 
method. Stability criteria have been presented when no input 
is present and asymptotic behavior of driven systems has been 
studied. The conditions obtained are straightforward to apply, 
as the discussion of the computer implementation has indicated. 

In the present form, the conditons are directly applicable to 
the study of systems with jitter or skipping to determine the 
effect of these imperfections. However, prior to use in other 
practical situations the following modifications should be 
incorporated. If one wants to analyze remote control systems, 
time delays in the control loop must be considered; also, for 
application to compensatory tracking functions one should give 
serious consideration to dead-zone non-linearities in the forward 
path. Both of the above constitute areas of future research. 
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APPENDIX 


SOME RELEVANT DEFINITIONS AND THEOREMS 

A few definitions and theorems will be present which are 
used throughout this paper. 

Definition A.l - Mean- Square Stability of a Random Process . - 
xft). x(t) is mean-square stable if Ye > 0, 36 (e) > 0 such that 
if | | x (t Q ) || < 6 , then E ( | |x (t) | | 2 ) < e , for all t > t Q . 

Definition A. 2 - Asymptotic Mean-Square Stability .- x(t) is 
asymptotically mean-square stable if 

(a) x(t) is mean square stable 

(b) lim E P | | x ( t ) | | 2_ | = 0 

t ->-00 L J 

Definition A. 3 - Stabi lity With Probability One .- x(t) is stable 
with probability one if Ye > 6^ e 1 > 0^ 36 (e , e ' ) > 0 such that 
if | |x (t Q ) || > 6 , then 

P [ sup | |x (t) || > e ' ] < e 
t*t 0 

Definition A. 4 - Asymptot ic S tability With Probability One .- 
x(t) is a symptotically stable wpl if 

(a) x (t) is stable wpl 

(b) lim x (t) = 0 wpl 

t-^oo 


Definition A. 5 - No n-Negative Supermartingale .- Let x n be a 
discrete Markov process and let V n = V (x n ) 2 0 have the property 
that 

E [ V n+l I x n] - V n = - K(x n> 4 °- 

Then the sequence {V n > is called a non-negative supermartingale 
sequence. 

Lemma A.l - (Doob Martingale Convergence Theorem) .- Suppose that 
{V n } is a non-negative supermartingale sequence. Then there is 
a V 2 0 such that V n -*■ wpl, and 

P{ sup V > e | x = x} < ^V(x) 
i n 1 o e 

ne [0 ,°°] 
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AlsoJ^E S K n I x 0 = X J - v 0 and K n -*■ 0 wpl. 

(For proof, see references A-l and A-2.) 

Lemma A . 2 - Let {x n } be a Markov process and V (x) a non-negative 
function. Suppose E [V n+1 | x r ] - V fi < -6V , 6 > 0. 

Then P{ sup V (1-6) n > e | x = x} £ — V (x ) 
r n i n o £ o 

ne [0 ,°°] 

and lim E[V n (l-6-^) n j x q = x} = 0 where 6^e(0,6). 
n 

Now, we shall restrict ourselves to first-order systems and 
make two more definitions for that case. 

Definition A. 6 — Stability of Or der s (s > 0).- x(t) is stable 
of order s if Ye > 0, 156 (e) > 0 such that if |x |s < 6, then 
E ( | x ( t ) | s ) < t. ° 

Definition A. 7 - Asymptotic Stability of Order s (s > 0).- x (t) 
is asymptotically stable of order s if 

(1) x(t) is stable of order s 

(2) lim |e j x ( t ) | s 1 = 0 

t-*°o L J 
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